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DESCRIPTION 

RECORDING APPARATUS, EDITING APPARATUS, DIGITAL VIDEO 
RECORDING SYSTEM, AND FILE FORMAT 

Technical Field 

The present invention relates to a recording apparatus, an 
editing apparatus, a digital video recording system, and a file format, 
for recording and editing video and audio data of a program 
material. 

Background Art 

In a conventional video recording system, a non-liner editing- 
system using a personal computer (PC) Is more effective In speedy 
random accessibility or editing convenience, as compared with a 
linear editing system using a video tape recorder (VTR). Especially, 
with a recent progress on high performance and low price of the PC, 
the non-liner editing system has been generally used. However, 
the non-liner editing system for handling a. high-bitrate material 
such as a high definition (HD) television program is experrsfvB> and 
in a case of a standard definition (SD) television program, it is not 
enough to perform editing work using a laptop outside of an editing 
room, for example, at a recording site, due to a processing speed. . 
and a capacity in a recording medium, such as a hard disk, for 
storing the material. 

One method for solving the above problems is disclosed In 
Japanese Translation of PCT International Application JPll-507184 
publication which provides a digital video recording system for 
recording the same program source material into the first format 
and the second format which are stored in the first recording 
medium and the second recording medium, respectively, together 
with respective time code information regarding the other format. 
The first format is encoded with a higher compression ratio 
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compared to the second format. The material recorded in the first 
format is edited off-line to generate editing information, and the 
material recorded in the second format is used to generate a final 
version of the program based on the editing information. Thereby 
5 it is possible to realize an editing system at a low price. 

However, in the digital video recording system disclosed in 
the above patent publication, the "time code information" is used to 
relate the recorded data in two kinds of formats each other, which 
are a high-resolution format and a low-resolution format, so that, 

10 there is no problem in managing those recorded data in two kinds of 
formats together, but when those data are sent or stored separately, 
this causes a problem that a relationship between those recorded 
data in both formats cannot be recognized, since this may cause 
existence of a plurality of files having the same time code, resulting 

15 in difficulty in maintaining the relationship between the 
high-resolution data file and the low-resolution data file. Moreover, 
there is a case where the time code information would be rewritten 
to be edited when a user edits the two kinds of data, and such a case 
also causes a problem that the relationship between those recorded 

20 data in both formats cannot be recognized. 

Moreover, in the conventional digital video recording system, 
a "file name" is, for example, automatically, assigned to a file in a 
recording apparatus, and used to relate recorded data in two kinds 
of formats each other, which are a high-resolution format and a 

25 low-resolution format. This case may cause a problem that the 
automatically assigned file name is changed by the user's input 
during user's editing work, and eventually it is impossible to relate 
those recorded data in two kinds of formats with each other. 

In order to solve the above problems, the present invention 

30 provides a digital video recording system which can always maintain 
the corresponding relationship between the recorded data in two 
kinds of formats having different degrees of the resolution, without 
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being later affected by user's operations, even if tliose recorded 
data are managed separately. 

Disclosure of Invention 

5 In order to solve the above conventional problems, a 

recording apparatus according to the present invention which 
records a first data with a high resolution and a second data with a 
resolution lower than the resolution of the first data as separate files, 
the first data and the second data being generated from a same 

10 video and audio source, the recording apparatus includes: an input 
unit operable to receive the video and audio source from outside; a 
first coding unit operable to code the video and audio source 
inputted from the input unit in order to generate the first data; a 
second coding unit operable to code the video and audio source 

15 inputted from the input unit in order to generate the second data, 
the second data being coded with a resolution lower than a 
resolution of the first data; and a recording unit operable to record 
at least the data coded by the first coding unit onto a recording 
medium, wherein the second data includes identification information 

20 unique to the first data. 

Furthermore, a file format of the second data is a MPEG-4 
format, and the identification information is an Unique Material 
Identifier and stored in a skip box in the MPEG-4 format. 

With the above structure, the recording apparatus can record 

25 at least the UMID which is identification information unique to the 
file of the first data onto the file of the second data. 

Still further, an editing apparatus which edits a first data with 
a high resolution and a second data with a resolution lower than the 
resolution of the first data that are recorded as separate files, the 

30 first data and the second data being generated from a same video 
and audio source, the editing apparatus includes a search unit 
operable to search for the first data corresponding to the second 

-3 - 



data by using Identification information unique to the file of the first 
data which is included in the second data, when the first data 
corresponding to the file of the second data is searched. 

Still further, a file fornnat of the second data is a MPEG-4 
5 format, and the identification information is an Unique Material 
Identifier and stored in a skip box in the MPEG-4 format. 

With the above structure, in the editing apparatus, the search 
unit can correctly search for the second data corresponding to the 
first data by using the UMID which is the identification information, 
10 so that it is possible to improve efficiency of editing work. 

Note that, in order to achieve the above objects, the present 
invention can be realized for a digital video recording system which 
includes characteristic units in the recording apparatus and the 
editing apparatus, and for a file format which is recorded by the 
15 recording apparatus and edited by the editing apparatus. 

The digital video recording system according to the present 
invention can maintain a corresponding relationship between 
recorded data in two kinds of formats, even if those recorded data 
are managed separately, and can shorten a required time period 
20 from recording a material as the two kinds of recorded data to 
broadcasting the material. 

Further Information about Technical Background to this 
Application 

25 The disclosure of Japanese Patent Application No. 

2004-299977 filed on October 14, 2004 including specification, 
drawings and claims is incorporated herein by reference in its 
entirety. 

30 Brief Description of Drawings 

These and other objects, advantages and features of the 
invention will become apparent from the following description 
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thereof taken In conjunction with the accompanying drawings that 
illustrate a specific embodiment of the invention. In the Drawings: 

FIG. 1 Is a functional block diagram showing a recording 
apparatus Included in a digital video recording system according to 
5 an embodiment of the present Invention; 

FIGS. 2A and 2B are diagrams showing a structure of a clip 
according to the embodiment of the present invention; 

FIG. 3 is a diagram showing a structure of a low-bitrate 
audio-video (AV) data file according to the embodiment of the 
10 present invention; 

FIG. 4 is a diagram showing a structure of an editing system 
according to the embodiment of the present invention; 

FIG. 5 Is a diagram showing a structure of an editing 
apparatus at a broadcast station according to the embodiment of the 
15 present Invention; and 

FIG. 6 Is a reference diagram showing a case where N 
recording media are copied onto a hard disk drive (HDD) in the 
editing apparatus according to the embodiment of the present 
invention. 

20 

Best Mode for Carrying Out the Invention 

The following describes an embodiment according to the 
present invention with reference to the drawings. 

FIG. 1 Is a functional block diagram showing a recording 

25 apparatus Included in a digital video recording system according to 
the embodiment of the present Invention. Referring to FIG. 1, the 
recording apparatus includes: a video signal input terminal 101 as a 
means for receiving video data; an audio signal Input terminal 102 
as a means for receiving audio data; a first encoder 103 as the first 

30 coding means; a second encoder 104 as the second coding means; 
a bus interface 105; a control signal input unit 106; a central 
processing unit (CPU) 107; a main memory 108; a ROM 109; a bus 
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110; and a recording mediunr) controller 111 as a recording means. 
Note tliat the recording apparatus further includes a network 
Interface 112 to be connected with a network through which a 
below-described low-bitrate audio-video (AV) data file is 
5 transmitted. 

A recording medium 113 is a semiconductor memory card and 
records a main material file with a high resolution and the like by 
using the recording medium controller 111. Note that a serial 
number unique to the recording medium 113 has been written into a 

10 non-volatile memory in the medium during manufacture, and is able 
to be read out according to a command from a host. 

FIG. 2 shows one example of files included in a clip generated 
by the system according to the present invention. One clip 
includes: a clip metadata file 201 which indicates information 

15 regarding the files included in the clip, and the like; main material 
files 205 which are a video data file 202 and an audio data file 203; 
and a low-bitrate AV data file 204 which is encoded with a bitrate 
lower than a bitrate of the main material files 205. Regarding 
formats of these files, the clip metadata file 201 is written in the 

20 Extensible Markup Language (XML), the main material files 205 are 
Material exchange Formats (MXFs), and the low-bitrate AV data file 
204 is a MP4 (MPEG-4) format. 

Firstly, the main material files 205 are described in more 
detail. The main materials 205 of video and audio data are the MXF 

25 formats which are compliant with the SMPTE-377M standard. As 
shown in FIG. 2B, each main material 205 includes a file header 206, 
a file body 207, a file footer 208, which are sequentially arranged 
from a head oiF the main material file 205. The file header 206 
stores metadata, such as a file structure parameter and a video or 

30 audio parameter, which are necessary to reproduce the MXF file. 
The file body 207 stores the video data and the audio data. The file 
footer 208 stores data indicating the end of the file. The file header 
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206 stores further metadata regarding the main material file 205. 
The further metadata includes: a material package which Is 
information defining how to reproduce the video data or the audio 
data on an output timeline; and a file package which is information 
for identifying the clip to be outputted on the timeline, both of which 
are assigned with respective identifiers called unique material 
identifiers (UMIDs). More specifically, as the UMIDs, a material 
package UMID (MP-UMID) is assigned to the material package, and 
a file package UMID (FP-UMID) is assigned to the file package. 

Regarding the files as the main material files 205, the video 
data is stored in one file per a clip, while the audio data is stored in 
separate files for respective channels, for example, two files when 
two channels are recorded. These files are generated from the 
same material, so that each MP-UMID Is identical, but each FP-UMID 
is, not like the MP-UMID, different from one another, and has a 
different value depending on whether the file stores the video data 
or the audio data, and depending on which channel the file stores for 
the audio data. 

A UMID is an identifier assigned to a generated material in 
order to global-uniquely identify an arbitrary audio-video material. 
The structure and creating method of the UMID are defined by the 
SMTPE-330M standard. The UMID mainly includes: a basic UMID 
(32 bytes) having a material number unique to each material; and 
an extended UMID (64 bytes) having, as extended information, 
attribute information (date, place, user name, for example) 
regarding the material. 

Note that the UMID creating rule is standardized not to create 
a plurality of identical UMIDs. In the embodiment of the present 
invention, the UMID is used to efficiently manage a material, even if 
a user sends or receives a file of the material to or from another user. 
If the user later manages the material and changes a name or a time 
code of the file, this does not cause any problems for managing the 
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material, but if the user later rewrites the UMID without authority, 
this results in failing to manage the material itself, which is a more 
serious and fundamental problem than failing to maintain a 
corresponding relationship between the main material files 205 and 
5 the low-bitrate AV data file 204. The present invention can be 
Implemented only under circumstances where the managed file is 
assigned with a not-overlapped correct UMID. 

Next, the clip metadata file 201 is described in more detail. 
The clip metadata file 201 stores: a clip name; a file name of each 

10 file including in the clip; a time code value of a video frame at a head 
of the clip; a length (time period) of the clip; information regarding 
a frame rate of the video data, a sampling rate of the audio data, and 
the like; a serial number of a recording medium in which the clip is 
recorded; and the like. The clip metadata file 201 further stores a 

15 clip UMID (CLIP-UMID) as an ID for identifying the material (clip). 
Note that, this CLIP-UMID and the MP-UMIDs in the video and audio 
data files are set to as the same UMID, since these UMIDS are IDs of 
the same clip. 

Next, the low-bitrate AV data file 204 is described in more 

20 detail. 

FIG. 3 is a diagram showing one example of a structure of a 
MP4 file which is a format of the low-bitrate AV data file 204 
according to the embodiment of the present invention. The MP4 file 
format is compliant with ISO/IEC 14496-1/AMD6 standard. All 

25 information is stored in a structure called a box. The information 
includes: a multiplexed video and audio bitstream (media data); and 
a management information (metadata) regarding the media data. 
Each box is assigned with an identifier of four characters to 
represent a box type. 

30 A file type box (ftyp) 301 positioned at a head of the file is a 

box for identifying the file. A media data box (mdat) 302 stores the 
multiplexed bitstream of video and audio data. A movie box 
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(moov) 303 stores the management information for reproducing the 
bitstream stored in the media data box. A skip box (skip) 304 
stores data whose readout is skipped during reproduction of the file. 
In the embodiment, as shown in FIG. 3, the skip box 304 
5 stores: a clip name 308 regarding the clip which includes the 
low-bitrate AV data file 204; a CLIP-UMID 309 which is the clip UMID 
assigned to the main material; a time code value 310 regarding a 
head frame in the clip; a serial number 311 of the recording medium 
in which the main material is recorded. Note that the skip box 304 

10 in FIG. 3 further includes a free space 305, a user data 306, a 
metadata 307, but the skip box 304 may include at least one of the 
UMID 309, the time code value 310, and the serial number 311. 

Next, operations performed by the recording apparatus 
shown in FIG. 1 is described. 

15 In the embodiment, referring again to FIG. 1, the video signal 

input terminal 101 receives a 4:2:2 component digital video signal. 
At the same time, the audio signal input terminal 102 receives 
digital audio signals from two channels, which are quantized at a 
sampling frequency of 48 kHz and 16 bits. The video signal 

20 received by the video signal input terminal 101 is inputted, as a 
signal obtained from the same source, into both the first encoder 
103 and the second encoder 104, to be coded by the respective 
encoders. In other words, the first encoder 103 and the second 
encoder 104 are inputted with the same video source at the same 

25 time, and then code the source separately. On the other hand, the 
audio signals received by the audio signal input terminal 102 are 
inputted only to the second encoder 104 to be coded. 

The first encoder 103 encodes the inputted video signal by a 
DVCPRO method. Note that, in the embodiment, the inputted audio 

30 signals are not coded by the first encoder 103, but the audio signals 
may be coded by the first encoder 103 as formats, such as MPEG 
formats, as far as the first encoder 103 codes the audio signals with 
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a bitrate higher than a bitrate used in the second encoder 104 as 
described further below. The bitrate for the video data file is about 
25 Mbps, while the bitrate for the audio data file is about 1.5 Mbps 
for two channels. 

5 The second encoder 104 codes the video data by the MPEG-4 

method and the audio data by the MPEG-2/AAC method in order to 
code those data with respective predetermined bitrates, and then 
multiplexes those coded data to generate data to be stored in the 
boxes in the MP4 format file, except the skip box. 

10 The control signal input unit 106 inputs commands, such as 

recording ON/OFF, a time code, material data attribute information 
to be set in the Uf^ID, and the like. The CPU 107 executes a 
processing program stored in the ROI^ 109 and the main memory 
108 (or one of them) based on the inputs by the control signal input 

15 unit 106. 

The DVCPRO format video data which is outputted from the 
first encoder 103, the MP4 file (except a skip box) data which is 
outputted from the second encoder 104, and non-compressed audio 
data which is inputted from the audio signal input terminal 102 are 

20 temporarily stored into a buffer via the bus interface 105, and then 
transmitted into the main memory 108 according to instructions 
from the CPU 107. 

Among these various data necessary to generate each file 
(except encoded data), a serial number of the recording medium 

25 113 has been read out prior to the recording processing, and has 
been stored in the main memory. The UMID, the clip name, the 
time code, and the like are set by the control signal input unit 106, 
or generated by the CPU 107 when the recording starts. 

In the main memory 108, the video data and the audio data as 

30 the main material are added with respective predetermined headers 
and footers, such as UMIDs, in order to generate respective I^XF 
format files. A low-bitrate AV data file is generated by adding data 
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to be stored in the skip box at the end of a file outputted from the 
second encoder 104. Furthernnore, a clip metadata file is 
generated and written into the recording medium 113. 

FIG. 4 is a diagram showing a structure of an editing system 
5 using the digital video recording system according to the present 
invention. At a recording site, a material is recorded as a clip onto 
a recording medium 402 by using a camera recorder 401 as the 
digital video recording system. From the recorded clip, a clip 
metadata file and a low-bitrate AV data file, but not main material 

10 files, are transmitted to a personal computer (PC) 403. On the 
other hand, the recording medium 402 in which the main material 
files are recorded is transported to a broadcast station. The 
transmission of the clip metadata file and the low-bitrate AV data file 
is performed via a network, for example, via the network interface 

15 112 shown in the structure of FIG. 1. Sizes of the clip metadata file 
and the low-bitrate AV data file are small enough to be transmitted 
in a short time period, so that a location of the PC 403 may be at the 
recording site, the broadcast station, or other places. 

The PC 403 creates an edit list by adding data, such as 

20 comments, to the clip metadata file, or by cutting work, during 
reproducing and confirming the low-bitrates AV data file by using a 
general-purpose viewer for reproducing the MP4 file. A time code 
of the cutting in the edit list is calculated according to the time code 
value at a head of the clip. Note that the special data, such as the 

25 UMID of the main material file or the serial number of the recording 
medium, are stored in the skip box, so that the special data do not 
affect the reproduction by the general-purpose viewer. The 
overwritten clip metadata file and the created edit list are 
transmitted to the broadcast station via the network. 

30 An editing apparatus 404 at the broadcast station writes all 

main material files recorded on the recording medium 402 into a 
hard disk drive (HDD), and stores those files into a database. Next, 
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the edit list, the clip metadata file, and the low-bitrate AV data file 
which are sent separately, are stored in the database. Here, by 
using the CLIP-UMID recorded in the clip metadata file, a search is 
performed from the stored main material files to find files having the 
5 same CLIP-UMID, and then relates the found files with the 
low-bitrate AV data file. By using the CLIP-UMID, it is possible to 
automatically relate those files without manual confirmation. After 
the relationships are registered in the database, the main material 
files are read out according to the edit list, so that it is possible to 
10 reproduce a content which is edited from the high-bitrate main 
material data. 

FIG. 5 is a diagram showing a structure of the editing 

apparatus 404 at the broadcast station. 

The editing apparatus 404 connected to a network interface 
15 501 includes a PC body 502, and a recording medium I/F 503, such 

as a drive, which is able to mount one or more recording media. 

The recording medium I/F 503 is connected to the PC body 502 via, 

for example, a universal serial bus (USB). 

The user sets a recording medium in the recording medium 
20 I/F 503, and then copies the main material files recorded on the 

recording medium onto a HDD 504 in the PC body 502. 

Furthermore, the PC 502 downloads the edited low-bitrate AV data 

file via the network interface 501, and searches by a search unit 505 

for a corresponding relationship between the low-bitrate AV data file 
25 and the main material files recorded on the HDD 504 by using the 

serial number of the recording medium and the CLIP-UMIDs. 

Thereby the editing apparatus 404 can automatically edit the main 

material files and the low-bitrate AV data file. 

FIG. 6 is a reference diagram showing a case where N 
30 recording media are copied onto the HDD 504 in the editing 

apparatus 404 of FIG. 5. A file structure in a recording medium 600 

as shown in FIG. 6 includes a clip metadata folder 601, a video data 
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folder 602, and an audio data folder 603, and the like, so that data 
is stored in separate folders depending on types of the files. 

When the recording medium is mounted and the files in the 
recording medium are copied, a serial number of the recording 
medium is read out to create a list indicating a corresponding 
relationship between the serial number and the folders in the 
recording medium. 

Then, in order to search by the search unit 505 In the editing 
apparatus 404 for the main material files corresponding to the 
low-bitrate AV data file inputted from the network I/F 501, a 
recording medium serial number in the skip box is read to identify a 
recording medium (folder). Next, a CLIP-UMID is read out and clip 
metadata files in a folder of the identified recording medium are 
sequentially searched, thereby searching for the same CLIP-UMID. 
Thereby it is possible to perform the search processing efficiently. 

As described above, in the digital video recording system 
according the embodiment, when the editing work is performed In a 
place which is different from the recording place during transporting 
the recording medium In which the main material files are recorded, 
it Is possible to always properly maintain the corresponding 
relationship between the main material files and the edited result of 
the low-bitrate AV data file, by using the CLIP-UMID recorded in the 
skip box of the low-bitrate AV data file. 

Furthermore, the low-bitrate AV data file and the main 
material file are automatically combined by using the serial number 
of the recording medium or the CLIP-UMID in order to generate final 
video data for broadcasting, so that it is possible to shorten a 
required time period from recording to broadcasting the material. 

Note that, each recording medium may, for example, be 
mounted as one folder when the main material files are written onto 
the HDD, it is possible to efficiently search for the main material files 
and to relate the files with one another, by identifying the recording 
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medium (folder) based on the serial number of the recording 
medium and then searching for main material files having the 
identical CLIP-UMID only in the files in the folder, when the main 
material files are searched and related with the low-bitrate AV data 
file or the like. 

Note also that, in FIG. 4, the PC 403 for the editing work and 
the editing apparatus 404 for the final editing for broadcasting have 
been described to be different apparatuses, but those apparatus can 
be a single same apparatus. In such a case, the files except the 
main material files are transmitted from the recording site to the 
editing apparatus 404 at the broadcast station via a network, and 
the editing apparatus 404 firstly performs editing work during 
reproducing the low-bitrate AV data material, and then after 
receiving the main material files, replaces the low-bitrate AV data 
file with the main material files to finally edit the data for 
broadcasting. In this case, when the main material files 
corresponding to the specific low-bitrate AV data file are searched in 
a plurality of recording media in which main material files are filed, 
it is possible to perform the search processing speedily, by firstly 
identifying the recording medium using a serial number of the 
recording medium and then searching for the main material files in 
the identified recording medium. 

Moreover, in FIG. 4, the recording medium 402 has been 
described to be transported directly to the broadcast station, but the 
main material files can be transmitted via a network. It takes 
considerable time to transmit the main material files, but if the 
low-bitrate AV data file has been transmitted prior to transmit the 
main material files, the editing work can be performed using the 
low-bitrate AV data file, so that it is also possible to perform the 
editing work efficiently. 

Furthermore, the low-bitrate AV data file is not necessarily to 
be recorded on the same medium in which the main material files 
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are recorded, but can be receded directly on the HDD in the PC via 
a networl< during recording the material, or can be recorded on 
another mediunn only for the low-bitrate AV data file. 

The ennbodiment has described that the clip has the structure 
of files, including the clip metadata file (XML format), the main 
material file of video data (MXF format), the main material file of 
audio data (MXF format), and the low-bitrate AV data file (MP4 
format), but the file formats and the structure of files are not limited 
to the above, as far as the main material files and the low-bitrate AV 
data file which is generated with a bitrate lower than a bitrate of the 
main material are included. The present invention can be applied 
for other various formats, for example, the main material file is a 
high-bitrate MP4 file and has identification Information unique to the 
file in the skip box, and the identification information is stored in the 
low-bitrate AV data file. 

Although only the exemplary embodiment of the present 
invention has been described in detail above, those skilled in the art 
will readily appreciate that many modifications are possible in the 
exemplary embodiment without materially departing from the novel 
teachings and advantages of the present invention. Accordingly, all 
such modifications are intended to be included within the scope of 
the present invention. 

Industrial Applicability 

The digital video recording system according to the present 
invention can properly maintain a corresponding relationship 
between the high-resolution first data and the low-resolution second 
data, even if the first data and the second data are generated as 
separate files to be recorded, sent, and managed, so that the digital 
video recording system is useful, for example, to record and edit 
video and audio data of a program material for broadcasting. 
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